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Abstract 

Let P{n,M) denote the minimum average Hamming distance of a binary code of 
length n and cardinahty M. In this paper we consider lower bounds on f3{n,M). All 
the known lower bounds on /3(n, M) are useful when M is at least of size about T'-^/n. 
We derive new lower bounds which give good estimations when size of M is about n. 
These bounds are obtained using linear programming approach. In particular, it is 
proved that lim (3{n,2n) = 5/2. We also give new recursive inequality for P{n,M). 
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1 Introduction 



Let T2 = {0, 1} and let J-"^ denotes the set of all binary words of length n. For x,y E T^-, 
d{x, y) denotes the Hamming distance between x and y and wt{x) = d{x, 0) is the weight 
of X, where denotes all-zeros word. A binary code C of length n is a nonempty subset of 
JF^. An [n, M) code C is a binary code of length n with cardinality M. In this paper we will 
consider only binary codes. 

The average Hamming distance of an (n, M) code C is defined by 

cGC c'GC 

The minimum average Hamming distance of an (n, M) code is defined by 

(3{n, M) = min{ d{C) : C is an (n, M) code} . 

An (n, M) code C for which d{C) = l3{n, M) will be called extremal code. 

The problem of determining (3{n, M) was proposed by Ahlswede and Katona in [2J. Upper 
bounds on f3{n,M) are obtained by constructions. For survey on the known upper bounds 
the reader is referred to P]. In this paper we consider the lower bounds on (3{n,M). We 
only have to consider the case where 1 < M < 2"~^ because of the following result which 
was proved in [6J. 

Lemma 1. For I < M < 2" 

'3(".2"-*0 = |-p;r^(|-/3(«.M)) . 

First exact values of P{n, M) were found by Jaeger et al. [7]. 

Theorem 1. ^ P{n,4:) = 1, /?(n, 8) = 3/2, whereas /or M < n + 1, M 7^ 4, 8, we have 
f M - 

^(n,M)=2(— ) . 

Next, Althofer and Sillke [3] gave the following bound. 
Theorem 2. |^ 

where equality holds only for M = 2^ and M = 2^~^. 
Xia and Fu [10] improved Theorem [2] for odd M. 
Theorem 3. fl^ If M is odd, then 



Further, Fu et al. [6] found the following bounds. 
Theorem 4. 

(3{n,M) > ^ - ^ + -J^ , if M ^ 2{mod 4) , 
p(n, M)> , for M < 2""^ , 

p(n, M)> — + — — , if M is odd and M < T'^ - 1 . 

' ^ - 2 M 2M2 ' 

Using Lemma [1] and Theorems [3l H] the following values of j3{n,M) were determined: 
(3{n, 2"-i ± 1), p{n, 2"~i ± 2), (3{n, 2'^-2), /3(n, 2"-^ ± i)^ ^(^^ 2"-i + 2"-2), 2"-^ + 2"-2 ± 
1). The bounds in Theorems [3|, H] were obtained by considering constraints on distance 
distribution of codes which were developed by Delsarte in [5j . We will recall these constraints 
in the next section. 

Notice that the previous bounds are only useful when M is at least of size about 2"~Yn. 
Ahlswede and Althofer determined (3{n,M) asymptotically. 

Theorem 5. /!]/ Let {M„}5^-^ be a sequence of natural numbers with < M„ < 2" for all n 

and lim inf ( M„/ ( , , I I > for some constant a, < a < 1/2. Then 
n^oo \ '\[an\)) ' ' 

lim inf^^^>2a(l-a). 

n^oo n 

The bound of Theorem [5] is asymptotically achieved by taking constant weight code 
C = {x G JF^ : wt{x) = [an\}. 

The rest of the paper is organized as follows. In Section [2] we give necessary background 
in linear programming approach for deriving bounds for codes. This includes Delsarte's 
inequalities on distance distribution of a code and some properties of binary Krawtchouk 
polynomials. In Section [3] we obtain lower bounds on i3{n, M) which are useful in case when 
M is relatively large. In particular, we show that the bound of Theorem [2] is derived via 
linear programming technique. We also improve some bounds from Theorem H] for M < 2"~^. 
In Section m we obtain new lower bounds on j3{n,M) which are useful when M is at least 
of size about n/3. We also prove that these bounds are asymptotically tight for the case 
M = 2n. Finally, in Section [5l we give new recursive inequality for /3(n, M). 

2 Preliminaries 

The distance distribution of an (n, M) code C is the {n + l)-tuple of rational numbers 
{Ao,Ai, ■ ■ ■ ,An}, where 

, _ \{{c,c')eCxC: d{c,c') = t}\ 
M 
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is the average number of codewords which are at distance i from any given codeword c G C. 
It is clear that 

n 

Ao = l , ^ = M and > for < 2 < n . (1) 

If C is an (n, M) code with distance distribution {Aj}"^Q, the dual distance distribution 
{-Si}"=o defined by 



n 

where 



M 

i=0 



n"w^E(-i)'G)(::;) (3) 

is the binary Krawtchouk polynomial of degree k. It was proved by Delsarte [Sj that 

5fc > for < A; < n . (4) 
Since the Krawtchouk polynomials satisfy the following orthogonal relation 

n 

Y,Pk{^)pm=s^,2\ (5) 

k=0 

we have 

n n 



111 I L -j #fc J I ly lb OTl 

fc=0 fc=0 j=0 i=0 fc=0 

It's easy to see from ([I]),©, ([3]), and (ED that 

5o = l and 1^5.. = ^ • (7) 

fc=0 

Before we proceed, we list some of the properties of binary Krawtchouk polynomials (see 
for example [8]). 

• Some examples are: Pq{x) = 1, P"(x) = n — 2x , 

_ {n - 2xf - n _ (n-2x)((n-2x)^-3n + 2) 

• For any polynomial f{x) of degree k there is the unique Krawtchouk expansion 

k 
1=0 

where the coefficients are 

1 " 

j=0 
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Krawtchouk polynomials satisfy the following recurrent relations: 
pn , {n-2x)P^{x)-in-k + l)P^_,{x) 

Pkix) = Pr\x) + P-I,\x) . (9) 
Let i be nonnegative integer, < i < n. The following symmetry relations hold: 

^)n"« = (^)^"(A^), (10) 

P-(t) = . (11) 

3 Bounds for "large" codes 

The key observation for obtaining the bounds in Theorems [31 H] is the following result. 
Lemma 2. [TO] For an arbitrary (n, M) code C the following holds: 

d{C) = i (n - 5i) . 

From Lemma [2] follows that any upper bound on Bi will provide a lower bound on f3{n, M). 
We will obtain upper bounds on Bi using linear programming technique. 
Consider the following linear programming problem: 

maximize Bi 

subject to 



J]P,"(z)5, >-Pfc(0) , l<k<n 



i=l 



and -Bj > for 1 <i <n. 
Note that the constraints are obtained from ([6]) and ([7]). 

The next theorem follows from the dual linear program. We will give an independent 
proof. 
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Theorem 6. Let C be an {n, M) code such that for 2 < i < n and 1 < j < n there holds 
that Bi ^ <^ i e I and Aj ^ ^ j E J. 

Suppose a polynomial X{x) of degree at most n can be found with the following properties. 
If the Krawtchouk expansion of X{x) is 



X{x) = Y,\R 

j=0 



then X{x) should satisfy 



Then 



A(l) = -1 , 
X{i) < for ie I , 
Xj > for j e J 



B, < A(0) - -Ao . (12) 



The equality in 112]) holds iff X{i) = for i E I and Xj = forj G J. 

Proof. Let C be an (n, M) code which satisfies the above conditions. Thus, using ([1]), (j2]) 
(jl]) and (j5]), we have 

n n -. n 

-B, = A(i)i?i > A(i)i?i + J2 Km = E ^(^)^^ = E ^(^) M ^ ^^^^^^^ 

iei «=1 i=l j=o 



n n 



n n n 



j=0 i=l 



j=0 i=l k=0 



-.71 'ri I I o 

E E E p^m^^u) - pmPoU) = E E ^^^^'^^ 



n n 



j=0 k=0 \ i=0 



j=0 k=0 



n n 



1 cyn 2" / 

E E ^^^^"(0) = M E - ^(0) = M + S ^^-^^^ 1 - 

j=0 fc=0 jr=0 \ JGJ 



2" 2" 
> — AoAo - A(0) = -Ao - A(0) 



□ 
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Corollary 1. If X{x) = ^AjP"(x) satisfies 

j=0 

1. A(l) = -1, <0 for2<i<n, 

2. Xj > for 1 < J < n, 
then 

/5(n,M) >^n-A(0) + ^Ac 

Example 1. Consider the following polynomial: 

A(x) = -1 . 

It is obvious that the conditions of the Corollary [1] are satisfied. Thus we have a bound 

' ^ - 2 M 
which coincides with the one from Theorem [2l 

Example 2. |^ Theorem 4] Consider the following polynomial: 



1 if i is even 
-1 if i is odd . 



From ffTTl) we see that 
and, therefore, 

\ /' A _ / ^ if ^ is even 
^^'^ ~ 1 -1 if Us odd . 

Furthermore, Aj = for I < j < n — 1 and A„ = 1/2. Thus, the conditions of the Corollary 
[1] are satisfied and we obtain 

Pin, M)> - n-^] =--^ . 

This bound was obtained in ^ Theorem 4] and is tight for M = 2"~^, 2""^. 

Other bounds in Theorems [3], H] were obtained by considering additional constraints on 
distance distribution coefficients given in the next theorem. 
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Theorem 7. ^ Let C be an arbitrary binary (n, M) code. If M is odd, then 



1 fn\ 

5, > — . , 0<i<n . 



M2 \i 

If M = 2{mod 4), then there exists an £ G {0, 1, ■ ■ ■ , n} such that 



M2 VV 2 , 

Next, we will improve the bound of Example [2] for M < 2*^"^. 
Theorem 8. For n > 2 



/3(n,M) > 



1-^ + ^(^-1) ifnisodd 



Proof. We distinguish between two cases. 

• If n is even, n > 2, consider the following polynomial: 

A(x) = — ^ (3 - n + P^i(x) + P„"(x)) . 



Using (fTTI) . it's easy to see that 

A(.) 



if i is even 

n—2 



i+l—n 
n-2 



if i is odd . 



If n is odd, n > 1, consider the following polynomial: 

2{n — 1) 
Using (fTTI) . it's easy to see that 

/ 2-i 



, if z is even 

n — l 



^ if i is odd . 

n—l 



In both cases, the claim of the theorem follows from Corollary [H □ 
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4 Bounds for "small" codes 

We will use the following lemma, whose proof easily follows from ([5]). 

n 

Lemma 3. Let \{x) = AjP"(x) be an arbitrary polynomial. A polynomial 

n 

a{x) = ^^Q;jP"(x) satisfies a{j) = 2"Aj iff ai = X{i). 



i=Q 



By substituting the polynomial X{x) from Theorem [6] into Lemma [3], we have the following. 

Theorem 9. Let C be an {n, M) code such that for 1 < i < n and 2 < j < n there holds 
that Aij^O<^ieI and Bj ^ j e J. 

Suppose a polynomial a{x) of degree at most n can be found with the following properties. 
If the Krawtchouk expansion of a{x) is 



a{x) = C(jPj 

3=0 



then a{x) should satisfy 



ai = l , 
ttj > , for j e J , 
a{i) < , for i E I . 



Then 



B,<^-ao. (13) 

The equality in 113]) holds iff a{i) = for i E I and aj = for j G J. 

Note that Theorem [9] follows from the dual linear program of the following one: 



maximize ^ Pl'{i)Ai = MBi — n 

i=l 

subject to 

n 



i=l 



1=1 

and v4j > for 1 < z < n, 
whose constraints are obtained from ([1]) and (jl]). 
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Corollary 2. If a{x) = ^^ajP"(a;) satisfies 

j=0 

1. a\ = 1, aj > for 2 < j < n, 

2. a{i) < for 1 < i < n, 
then 



/?(n, M) > - n + tto 



2 V M 
Example 3. Consider 

a{x) = 2-n + Pi"(x) = 2(1 - x) . 
It's obvious that the conditions of the Corollary [2] are satisfied and we obtain 
Theorem 10. 

(3{n,M)>l-^. 

Note that the bound of Theorem [TOl is tight for M = 1, 2. 
Example 4. Consider the following polynomial: 

a{x) = 3-n + P^{x) + P„"(a;) . 

From fill I) we obtain 



a[i] 



A — 2i if 2 is even 
2 — 2i if i is odd . 



Thus, conditions of the Corollary [2] are satisfied and we have 
Theorem 11. 

' ' - 2 M 
Note that the bound of Theorem [TT] is tight for M = 2,4. 

Example 5. Let n be even integer. Consider the following polynomial: 
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In this polynomial ai = 1 and aj > for 2 < j < n. Thus, condition 1 in Corollary [2] is 
satisfied. From (fTOl) we obtain that for nonnegative integer i, < i < n, 



and, therefore. 



It follows from (IHl) that 



p" ( - + 1 

n + 2)(^) ' b + 



-2, P^' 



n 



A-n 



Pi' 



n 



n-2 



(15) 



- 2)(r2 - 8) 



n 



A" - + 1 



(ra - 2)(4 -n) 



(16) 



Now it's easy to verify from (HM and (ITBi) that a(l) = a(2) = a(3) = 0. We define 



n + 2 



(- + 2)0 



It is clear that a{i) < a{i) for < i < n. We will prove that a{i) < for 4 < i < n. From 
( ITTl) and (fT6ll one can verify that 



5(n) = 0, 5(n - 1) = 5(n - 2) = ^^^^^ — ^, and 5(n - 3) = 2(6 - n) (17) 

n + 2 

which implies that a{n — j) < for < j < 3 (of course, we are not interested in values 
5(^^ — j), < j < 3, if n — j G {1,2,3}). So, it is left to prove that for every integer i, 
4 < i < n — 4, a{i) < 0. Note that for an integer i, 4 < i < n/2, 



. n(4-n) , 4(") 



P" • ( - + 1 

n—i \ 2 



< 



n{4-n) , 4(^) 

^^ + (2.-.) + 

n{4 — n 



n + 2 



+ (n - 2i) + 



(- + 2)0 
40 



n 



[n 



+ 2)0 



4)t+ii^"(- + l 



^"Q + l)|=5(z). 



Therefore, it is enough to check that a{i) < only for 4 < i < ri/2. 
From (|T6l) we obtain that 



5(4) 



' <0 and ai5) = -4--^^t^^<0 



n — 3 



(n + 2)(r2-3) 

where, in view of f fT7|) . we assume that n > 8. To prove that a{i) < for 6 < z < r2/2 we 
will use the following lemma whose proof is given in the Appendix. 
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Lemma 4. Ifn is an even positive integer andi is an arbitrary integer number, 2 < i < n/2, 
then 



n 

LfJ 



By Lemma m the following holds for 2 < i < n/2. 



n + 2 



n(4: — n) "'V2M|^| 
<— :r^ + n-2i+ 



^(2)(|^|) Qn 



n 



pr[- + i 



n + 2 



12 



n + 2)(^) n + 2 

4G)(Lij) 



2i 



4(2) (lIj) 
(^ + 2)0 



2(z-3) + 



n + 2 ■ (n + 2)(^) ' 

Thus, to prove that a{i) < for 6 < i < r;,/2, it's enough to prove that 

for 6 < i < n/2. 

Lemma 5. Let n be an even integer. For 6 < i < n/2 we have 

(»-3)(") > «(«-!) 



(m) 



n + 2 



The proof of this lemma appears in the Appendix. 

We have proved that the both conditions of the Corollary [2] are satisfied and, therefore, 
for even integer n, we have 

P{n,M) > - 

n + 2 M 

Once we have a bound for an even (odd) n, it's easy to deduce one for odd (even) n due 
to the following fact which follows from ([9]). 

n 

Lemma 6. Let a{x) = ajPJ^{x) be an arbitrary polynomial. Then for a polynomial 



3=0 



n-l 



where 



the following holds: 



/^j = ^3 + ' < J < n - 1 , 
/i(x) = a{x) for Q < X < n — 1 . 
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Example 6. Let n be odd integer, n > 1. Consider the following polynomial: 
K^) = ^ + Pii^) + 



n + 3 



which is obtained from a{x) given in (HM by the construction of LemmaEl Thus, by Corollary 
[21 for odd integer n, we have 



P{n,M) > 



3{n + l) n + 1 



n + 3 M 

We summarize the bounds from the Examples O [6] in the next theorem. 
Theorem 12. 

if n is even 



3ra _n_ 

n+2 M 



(3{n,M) > 

' n+3 M 

Example 7. For n = 1 {mod 4), n ^ 1, consider 



3(n±l)_2l+i tfnisodd 



One can verify that 



(l_n)(n-5) 4n(n-2) , pn. ^ 



(19) 



a(0) = 4(n-l), a(l) = a(2) = a(3) = a(4) = , a(5) = a(6) 



and 



(n - 1)2 

afn) = —6 : — , a{n — 1) = a{n — 2) = a{n — 3) = a{n — 4) 



n + 1 



4(1 -n) 
n - 4 



^ (n — 5)(n — 1) 
n+1 



a{n — 5) = a{n — 6) 



We define 



(1 - n)in-h) ™. X 



2(n - 9)(n - 2)(n - 1) 
(n + l)(n - 4) 

4n(n - 2) 



pn 



n + 1 



n + 1 ■ (n + l)(^) 

As in the previous example, it's easy to see that a{i) < a{i) for < i < n and 

5(n -i) < a{i) for < i < (n - l)/2 . 

Therefore, to prove that a{i) < for 1 < i < n, we only have to show that a{i) < for 
7 < i < (n — l)/2. It is follows from the next two lemmas. 

Lemma 7. Ifn is odd positive integer andi is an arbitrary integer number, 2 < i < (n — 1)/2, 
then 



pn 



n + 1 



< 



n 
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Lemma 8. Let n he odd integer. For 7 < i < {n — 1) /2 we have 



(i-4)(») ^ 2n(n-2) 



(m) 



n + 1 



Proofs of the Lemmas U\ M are very similar to those of Lemmas HI [5], respectively, and they 
are omitted. Thus, we have proved that the conditions of the Corollary [2] are satisfied and 
we have the following bound. 

(3(n, M) > \ - ^ , if n = 1 (mod 4) , n^l . 

' ^ - 2{n + l) M ' ^ J ^ r 

From Lemma O by choosing the following polynomials: 



if n = {mod 4), 
Jl{x) 



n + 2 



(n + 2)(5tl) 



n + 3 



(n + 3)(^2) 

2 ' 

(n + 3)(n+3j 2 



if n = 3 (mod 4), n 7^ 3, and 
16 + 3ra - ^2 



+ Pi"(a;) + 



4(n + l)(n + 3) 



n + 4 ■ ■ (n + 4)r^3) 

2 ^ 

12(n + l)(ri + 3) 



(p^2(x) +P^(x)) 



(n + 4)(^3) 
^ 2 ' 

if n = 2 (mo(i 4), n 7^ 2, we obtain the bounds which are summarized in the next theorem. 



Theorem 13. For n > 3 



7n+2 2n 



P{n,M) > < 



2(n+2) M 

7n— 5 
2(n+l) 

7n+16 
2(n+4) 



2?i 
Af 




= {mod 4) 


2(n-l) 
A/ 


ifn 


= 1 (mo(i 4) 


2(n+2) 
M 


ifn 


= 2 (mod 4) 


2(n+l) 
A/ 


ifn 


= 3 {mod 4) 



It's easy to see that the bounds of Theorems [T2] and [T3] give similar estimations when the 
size of a code is about 2n. 
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Theorem 14. 



lim f3{n, 2n) = - . 

n— >oo 2 



Proof. Let C be the foUowing [n, 2n) code: 



000 ■■ 


■ 00 


100 ■■ 


■ 00 


010 •• 


• 00 


000 ■■ 


■ 01 


110 ■■ 


■ 00 


101 ■■ 


■ 00 


100 •■ 


■ 01 



One can evaluate that 



p{n,2n) < d{C) 



5 An -2 



On the other hand, Theorem [12] gives 



I if n is even 

2 n+2 



5 13n+3 



if n is odd 



(3{n,2n) > 

2 2n(?i+3) 

The claim of the theorem follows by combining ( l20l) and ( l2Tll . 



5 Recursive inequality on M) 

The following recursive inequality was obtained in [TO] : 



Mn 

P{n, M + 1) > ^--^/?(n, M) + 



(M + l)2^' ' ' (M + l)2 

In the next theorem we give a new recursive inequality. 
Theorem 15. For positive integers n and M, 2 < M < 2" — 1 



p{n,M+l) > 



M2 - 1 

Proof. Let C be an extremal (n, M + 1) code, i.e.. 



/?(n,M) . 



p{n,M+l) = d{C) 



(M + 



cec c'ec 
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Then there exists Cq G C such that 

J2 dico, c) > (M + l)/5(n, M + 1) 



cec 



Consider an (n, M) code C = C \ {cq}. Using we obtain 

/3(n,M) < 



(24) 



dic) = E E ^(^' = f E E ^(^' - 2 E ^(^0, 

c'gc \cec c'ec cec 



<j^{{M+ lff3{n, M + 1) - 2(M + l)(3{n, M + 1)) 



M2 - 1 

M2 



/3(n,M+ 1) . 



□ 



Lemma 9. For positive integers n and M, 2 < M < 2" — 1, the RHS of (E3|j zs not smaller 
than RHS of 

Proof. One can verify that RHS of (!23|) is not smaller than RHS of (!22|) iff 



/3(n,M) < 



M2 2 



By fl23|) we have 



- 1 - 1 - 1 n 

Pin, M) < — rp^/?(n, M + 1) < — rp^/?(n, 2") = 



M2 



M2 



M2 2 



which completes the proof. 



□ 



6 Appendix 

Proof of Lemma |4l The proof is by induction. One can easily see from ( |T6l) that the 
claim is true for 2 < i < 5, where i < n/2. Assume that we have proved the claim for 
A<i <k <n/2-l. Thus 



n 



Pk+i ( :r + 1 



-2)P,"(f + l)-(n-A; + l)P^_Jf + 1) 



k + l 



< 



k + l 



n 



k + l 



k + l 



pn 



n 



< 



n 



n — k + I f n 



k + l VL¥J 



* . 
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We distinguish between two cases. If k is odd, then 



k+1 



n 

k-l 



n — k + 1 f n 



k+l 



fc-i 



k+l 



n 

fc-i 



n - Kr f n \n - k + ?, n - k + 3 / n 



fc-l fc+l \ til / 9 



2n- k + l\^ 



Therefore, for odd k, we obtain 



n 



Pk+i (2+1 



< 



n 

k+l 
2 



n 



If k is even, then 



(*) 



2 fn\ — k + 1 f n 



k + l 



k + l Vf-1 



2 fn\ n — k + I 



+ 



n 



1) 



fc+l 



-1) 



2 ^ n-A; + l 



A;+l 2n-A; + 2 k + l 



Since > 4, we have 




k + l 2n-k + 2 k + l 



\ 



< 



2 

5 + 



Therefore, for even k, we obtain 



"n 

'k+l I - + 1 



n 

< I k 

2 



n 

m 



Proof of Lemma [5t Denote 



flj = — , „ , , 6 < « < n/2 . 



(lIj) 



Thus, 



a6(n + 2) (n + 2)(n-3)(n-4)(n-5) 



n(n — 1) 



40n(n - 1) 
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n>12 

_(n-2)(n-7) 48n - 120 ^ 5 48-12 - 120 5 
~ 40 ^ 40n(n - 1) " 4 ^ 40n(n - 1) ^ 4 

ti(ti — 1 J 

and we have proved that ag > +2~' "'^^^'^ ^^^^ a, > for 6 < i < n/2. Let i be 

even integer such that 6 < i < n/2 — 2. Then 

i>6 i<n/2-2 

ai+2 (i — l)(n — i — l)(n — i) (i — 3)(n — 2i)(n — i) n — i ^ 
"oT ~ (i-3)(i + l)(n-2z) ^ {i-3){i + l){n-2i) ~ i + 1 ^ 

TiiTl — 1) Tiifl — 1) 

Together with og > , this imphes that Oj > for every even integer i, 

n+2 n+2 

6<i< n/2. 

Now let i be even integer such that 6 < i < n/2 — 1. Then 

i<n/2-l 

Oi+i ^ (i-2)(n-i) n - i ^ 
Ui ~ (i-3)(i + l) i + 1 

which completes the proof. □ 
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